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The Center 



Every child has the capacity to succeed in school and in life. Yet far too many children, especially 
those from poor and minority families, are placed at risk by school practices that are based on a 
sorting paradigm in which some students receive high-expectations instruction while the rest are 
relegated to lower quality education and lower quality futures. The sorting perspective must be 
replaced by a “talent development” model that asserts that all children are capable of succeeding in 
a rich and demanding curriculum with appropriate assistance and support. 

The mission of the Center for Research on the Education of Students Placed At Risk 
(CRESPAR) is to conduct the research, development, evaluation, and dissemination needed to 
transform schooling for students placed at risk. The work of the Center is guided by three central 
themes — ensuring the success of all students at key development points, building on students’ 
personal and cultural assets, and scaling up effective programs — and conducted through research 
and development programs in the areas of early and elementary studies; middle and high school 
studies; school, family, and community partnerships; and systemic supports for school reform, as 
well as a program of institutional activities. 

CRESPAR is organized as a partnership of Johns Hopkins University and Howard 
University, and supported by the National Institute on the Education of At-Risk Students (At-Risk 
Institute), one of five institutes created by the Educational Research, Development, Dissemination 
and Improvement Act of 1994 and located within the Office of Educational Research and 
Improvement (OERI) at the U.S. Department of Education. The At-Risk Institute supports a range 
of research and development activities designed to improve the education of students at risk of 
educational failure because of limited English proficiency, poverty, race, geographic location, or 
economic disadvantage. 
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Executive Summary 



This is the final report of a three-year evaluation of Core Knowledge Sequence implementation in 
12 schools nationwide. The Core Knowledge Sequence, a whole-school curricular reform model, 
provides a planned progression of specific topics to teach in language arts, history, geography, math, 
science, and the fine arts for Grades K-6 (Core Knowledge Foundation, 1995, 1998). The major 
goals ofthis evaluation were to determine (a) the conditions under which Core Knowledge is likely 
to achieve reasonably full implementation, and (b) the effects of Core Knowledge Sequence 
implementation in a variety of contexts. 

The 12 Core Knowledge schools (six promising or new implementation sites and six 
advanced implementation sites) in this study are located in seven states (Colorado, Florida, Ohio, 
Maryland, Tennessee, Texas, Washington) and are situated in various community (urban, rural, 
suburban), racial, and socio-economic contexts. Approximately half of the schools serve a majority 
population of students who are eligible for the federal free- or reduced-price lunch program. 

Implementation Results: At the end of three years (1998), all 12 schools were still implementing 
the Core Knowledge Sequence. Nine of the 12 schools had reached moderate or high levels of 
implementation. Core implementation improved and increased dramatically in four of the six new 
sites over the past three years. In fact, some of these sites reached implementation levels that are 
consistent with, if not superior to, some of the advanced sites. Implementation also improved or 
remained at consistently high levels in five of the six advanced implementation sites. Core 
Knowledge implementation waned over time considerably in one of the original advanced sites and 
one of the original promising sites, leading us to conclude that while all 12 schools reported that they 
were implementing Core Knowledge, 10 schools were authentically doing so. 

Components for Successful Implementation: Multilevel support for change was required for Core 
Knowledge to be successfully implemented. Successful implementation relied on instructional 
leadership from the principal, teacher willingness to change, and support from the district or at least 
a commitmentthatthe district would enablerather than hinder long-term implementation. Successful 
implementation also relied upon fiscal resources to provide for the purchase of Core materials and 
paid teacher planning time, as well as the organization oftime, space, and professional development 
designed to support Core. Core Knowledge implementation was hindered by the absence of 
multilevel support and the presence of strong pressures to comply with state standards and 
accountability systems that were ill-aligned with Core. Such pressure, wherever present, diverted 
educators from Core implementation. Core Knowledge was not effectively implemented in highly 
troubled school sites experiencing serious difficulties with school climate and discipline. 
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The Effects of Core Knowledge Implementation on Schooling Practice: Implementing Core 
Knowledge consistently contributed to making instruction more interesting and content-rich for 
students, provided coherence to the curriculum, and contributed to increased teacher collaboration 
and professionalism. Core Knowledge was also associated with more hands-on, activity-based 
instruction. However, it should be noted that these approaches are not officially sanctioned by the 
Core Knowledge Foundation, and methods for teaching Core were chosen by each local school and 
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its teachers. Core Knowledge implementation was also associated with greater academic engaged 
time in schools. These qualitative outcomes suggest changes in schooling practice. However, while 
Core adds substantially to teachers’ professional lives, one side effect (often viewed negatively) 
associated with this is that planning for teaching Core is very work intensive. 

Achievement Outcomes: The quantitative component of this evaluation examined (a) experimental- 
control differences in achievement gains over three years, (b) the relationships between level of 
implementation and academic gains, and (c) differences in gain by cohort (one cohort was followed 
from first through third grade at each school, and a second cohort was followed from third through 
fifth grade). For both cohorts, Core Knowledge effect sizes for the Core Knowledge test outcomes 
were large, and educationally meaningful. The analyses of norm-referenced reading and math scores 
yielded similar outcomes for Core Knowledge and comparison schools. However, strong correlations 
between level of implementation and norm-referenced math and reading gains indicate that when 
schools implemented the Core Knowledge Sequence with greater consistency, students achieved 
improved outcomes in both subjects. 

Why did Core Knowledge implementation lead to positive effects? The most plausible 
explanation for the positive effects associated with Core Knowledge is the greater curricular 
coherence it creates within individual schools. Core Knowledge implementation produced more 
clarity of goals, less repetitiveness in the curriculum, and more content-rich instruction for students. 
Where successfully implemented, Core Knowledge had become a vehicle for much more lively 
professional discussion and sharing among teachers. However, what appears to have mattered most 
was the fact that the curriculum was specified , and less so that it was Core Knowledge content. This 
leads us to the conclusion that the benefits associated with a specified curriculum may not be limited 
to Core Knowledge per se, but instead may be applicable to other specified curricula, even a fully 
articulated curricular sequence developed by schools themselves — so long as the content covered 
is broad, sequential, and well grounded in theory and research. 
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I. Introduction 



Enter the main door of the school and you are welcomed by a collection of African 
masks. A bulletin board on which students have drawn maps of their neighborhood 
and identified examples of Greek architecture grabs your attention as you stroll 
down the hallway. Another map shows places where Vikings traveled and traded 
around the world. Still another bulletin board displays the similarities and 
differences between Mayan and Egyptian pyramids. 

Displays and dioramas of student work dot the hallway. Pieces of silver and the 
picture of George Washington saved by Dolly Madison complete the students ’ 
varying interpretations of the burning of the White House during the War of 1812. 

A table displays reconstruction of the Underground Railroad.... 

Peer into classrooms and you will see students involved in exciting interdisciplinary 
projects. While one class investigates the interactions of Newton 's Laws on the 
exciting world of amusement park rides , another class analyzes the chain of events 
in Shakespeare's Macbeth... On a typical day , students are moving about the 
school. Some are scurrying to share their latest stories. Others are searching for 
evidence of heat exchange throughout the school. Still more are conducting 
interviews , asking students and staff who their heroes are and why. 

— Mentzer & Shaughnessy, 1996, P. 13 

The above description of a Core Knowledge school in San Antonio, Texas, is written by two 
teachers. The school, Hawthorne Elementary, serves a low-income, predominantly Hispanic student 
population. We chose to include this description in our report because it very accurately captures the 
essence of the schools we visited as part of a national evaluation of the implementation of the Core 
Knowledge Sequence. 

The Core Knowledge Sequence, a whole-school curricular reform model, provides a planned 
progression of specific topics to teach in language arts, history, geography, math, science, and the 
fine arts. It is designed so that students build on knowledge from year to year in grades K-6 (Core 
Knowledge Foundation, 1995, 1998). The Core Knowledge Sequence of topics is intended to 
constitute half of a school’s curriculum. The most distinguishing feature of the Core Knowledge 
Sequence is its content specificity. While the Core Knowledge Sequence specifies content, it does 
not specify pedagogical strategies. It also does not specify plans for implementation, providing only 
general guidelines for how a school might implement the sequence (Jones, 1991). 

E.D. Hirsch, Jr., a professor of English at the University of Virginia, first presented the 
thesis behind the Core Knowledge Sequence in his controversial bestseller, Cultural Literacy (1 987). 
In Cultural Literacy , Hirsch provided a list of what every American should know. The book was 
criticized as promoting arbitrarily decided, elitist forms of knowledge. Responding to that criticism, 
Hirsch convened an advisory board of experts in multiculturalism and consulted an independent 
group of educators, scholars, and scientists to attempt to make a master list of content topics for 



Grades K-6 that was inclusive of diverse perspectives. The Core Knowledge Foundation maintains 
that “Core Knowledge is an antz-elitist idea. It aims to guarantee equal access for all to the 
knowledge necessary for higher literacy and learning” (Core Knowledge Foundation, 1998, p. 9). 

The Core Knowledge Sequence was first piloted in 1990 in a Florida elementary school. 
Based on that implementation, significant revisions were made. Revisions continue to be made to 
the Sequence as the non-profit Core Knowledge Foundation, chaired by Hirsch, receives feedback 
from schools using the curriculum. The products of these ever evolving efforts can be seen in a series 
of books titled, What Your First [2nd, 3rd, Etc.] Grader Needs to Know: Fundamentals of a Good 
First [2nd, 3rd, Etc.] Grade Education (Hirsch, various dates). Educators from schools using the 
curriculum also convene annually at a national conference of Core Knowledge, during which time 
they share lessons and experiences. 

Core Knowledge is growing in popularity. The Core Knowledge Sequence is taught in more 
than 800 schools nationwide, and the numbers continue to grow. In 1998, Core Knowledge was 
approved as research-based reform design under the federal Comprehensive School Reform 
Demonstration Program (CSRD). 1 This will likely lead to expanded implementation of Core 
Knowledge in schools (particularly Title I schools) across the country. Moreover, E.D. Hirsch’s 
recent book. The Schools We Need and Why We Don 't Have Them (1996), which provides strong 
support for Core Knowledge, has received positive press nationwide. A New York Times reviewer 
called The Schools We Need “the most important book on education in 1996” (Mosle, 1996). 

Surprisingly, there has been only a modest amount of research on the implementation of the 
Core Knowledge Sequence. Analyzing data from a single school in San Antonio, Texas, Schubnell 
(1996) concluded that, “[W]ith respect to reading performance, the successive grade-level increases 
for Hawthorne in general show stronger upward trends than are evident in San Antonio Independent 
School District (SAISD) schools in the aggregate” (p. 39). In a three-year study of the first six Core 
Knowledge schools in the state of Maryland, Stringfield and McHugh (1998) found that, “[T]he 
majority of Core Knowledge schools posted three-year academic achievement gains in reading 
comprehension relative to their matched control peers as measured on a [norm-referenced test]. In 
addition, during the three-year period... third grade students in Core Knowledge schools showed 
greater gains [on the state’s performance based test] than did their matched control schools or the 
mean of schools state-wide” (p. 1). This report represents the first systematic national evaluation of 
Core Knowledge implementation across multiple schools. 



1 The Comprehensive School Reform Demonstration Program, based on the bipartisan Porter-Obey Amendments of 1 998, 
allows for $145 million of federal funding to go to schools adopting research-based reform models. The majority of the 
funding is allocated for Title I schools. 
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II. Overview of Evaluation 



This evaluation was conducted by researchers at the Center for Social Organization of Schools at 
Johns Hopkins University and the College of Education at the University of Memphis. The goal of 
this evaluation was to determine the effects of Core Knowledge Sequence implementation in a 
variety of contexts. This three-year, longitudinal evaluation began in November, 1995 and ended in 
September, 1998. The major research questions of this evaluation were: 

• What actions are necessary to achieve reasonably full implementation of Core 
Knowledge? 

• Under what conditions is the implementation prognosis favorable, and under 
what conditions is Core Knowledge unlikely to achieve reasonably full 
implementation? 

• As contrasted with reasonable controls, how effective is the Core Knowledge 
Sequence under conditions of reasonably full implementation? 

In order to answer these questions, we conducted a study of six schools deemed by the Core 
Knowledge Foundation to be relatively advanced in their implementation of the Core Knowledge 
curriculum, and six schools deemed as new, promising implementation sites. For quantitative 
comparison purposes, control schools were chosen for four of the advanced implementation sites 
(control schools for two of these advanced implementation sites could not be found). The research 
design does not include control schools for the promising implementation sites. 

The 12 Core Knowledge schools are located in seven states (Colorado, Florida, Ohio, 
Maryland, Tennessee, Texas, Washington) and are situated in various community (urban, rural, 
suburban), racial, and socio-economic contexts. Approximately half of the schools serve a majority 
population of students who are eligible for the federal free- or reduced-price lunch program. A list 
of the schools follows in Table 1. For the purpose of confidentiality, pseudonyms are used for all 
place and person names. 



A. Qualitative Component 

The qualitative component of this evaluation involved conducting longitudinal, comparative case 
studies (Yin, 1989) ofthe 1 2 Core Knowledge schools. In conducting these case studies, our research 
team visited each of the advanced implementation sites a total of five times over the course of the 
three-year study. A two-person team conducted each site visit. This involved two 2-3 day site visits 
in Year 1, one 2-3 day site visit in Year 2, and two 2-3 day site visits in Year 3. Our case studies of 
the new implementation sites involved only slightly less data gathering. We conducted two site visits 
in Year 1, a brief site visit in Year 2 (principal interview only), and two site visits in Year 3. 
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Table 1: List of Schools in Sample 



School 


Total # of 
Students 


% Free- or Reduced- 
Price Lunch 


Racial/Ethnic 

Composition 


Florida ADVANCED 
Woodlands 


922 


31% 


82.4% White 
1 1 .9% Black 
4.7% Hispanic 
1% Other 


Florida CONTROL 


475 


34% 


50% Black 
48% White 
2% Asian 


Texas ADVANCED 
Englewood 


487 


96% 


85% Hispanic 
6% Black 
8% White 
1% Asian 


Texas CONTROL 


559 


82% 


96% Hispanic 
3% White 
1% Black 


Maryland ADVANCED 
Garvey 


450 


63% 


98% Black 
2% Other 


Maryland CONTROL 


344 


65% 


96.7% Black 
3% White 
0.3% Asian 


Washington ADVANCED 
High Country 


492 


29% 


76% White 
20% Hispanic 
2% Asian 
1% Black 
1 % Other 


Washington CONTROL 


480 


38% 


79% White 
13% Hispanic 
5% Black 
3% Asian 


Colorado ADVANCED 
Peabody 


499 


6% 


90.8% White 
4% Asian 
3.2% Hispanic 
1% Black 
1% Native Am. 


Ohio ADVANCED 
Smithtown 


500 


60% 


100% White 


Florida NEW 

Alder 


670 


52% 


63% White 
27% Black 
10% Hispanic 


Texas NEW 
Riverside 


496 


44% 


55% White 
25.2% Hispanic 
17.1% Black 
2.2% Asian 
0.2% Native Am. 


Maryland (1) NEW 
Colonial 


403 


74% 


70% Black 
30% White 


Maryland (2) NEW 
Vine 


606 


10% 


84% White 
14% Black 
1% Hispanic 
0.5% Asian 
0.5% Native Am. 


Colorado NEW 
Newton 


280 


6% 


93.2% White 
3.6% Hispanic 
1.1% Black 
0.4% Native Am. 


Tennessee NEW 
Carson 


500 


86% 


100% Black 
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Interviews. During our site visits, we used semi-structured protocols to conduct interviews 
and focus groups (Krueger, 1994) with school staff to determine the successes and challenges they 
faced in implementing the Core Knowledge Sequence. We interviewed principals (and sometimes 
assistant principals) during each visit. As we followed the first-through-third-grade cohort and the 
third-through-fifth-grade cohort from the beginning of our study onward, we interviewed first and 
third grade teachers in the first year, second and fourth grade teachers the second year (in advanced 
implementation sites), and third and fifth grade teachers the final year. Interviews with school district 
administrators and some parents were also conducted throughout the study, as well as fifth grade 
student focus groups in the final year. New interview protocols were developed for each round of 
site visits, based on ongoing data analyses and emerging questions. All interviews were taped and 
transcribed verbatim at the completion of each visit. 

Classroom Observations. Our study involved following the achievement and schooling 
experiences of two cohorts of students over a three-year period. We conducted classroom 
observations at the first and third grade levels in 1995-96, at the second and fourth grade levels in 

1996- 1997 (in advanced sites only), and at the third and fifth grade levels in all of sites during the 

1 997- 98 school year. These observations consisted of whole school day observations in classrooms 
the first year and two-to-three one-hour observations per teacher in each grade for each subsequent 
year. 2 In addition to recording qualitative running notes of classroom activities, we employed an 
instrument called the Classroom Observation Measure (COM). The COM was developed at the 
University of Memphis and has been validated in extensive pilot research and other studies of 
elementary school classroom instruction (Ross, Smith, Lohr, et al., 1991, 1994). 

The COM was developed based on a review of observation instruments used in previous 
studies and includes both interval coding, obtained through systematic and relatively objective data 
recording, and holistic ratings and descriptions that reflect more global, subjective impressions of 
the classroom activities observed (Ross, Smith, Lohr, et al., 1991, 1994). A detailed manual 
describing the observation procedures and operationally defined categories accompanies the COM, 
and all observers for the Core Knowledge National Evaluation received training in how to use the 
COM. 



The COM consists of the following parts: 

Parts land II: Classroom Makeup and Physical Environment. This section is used to record 
demographic information about the classroom (class size, racial and gender composition, teachers 
and aides), seating arrangements, and classroom resources. 

Part III: Interval Coding. This section is used to record observations from nine 1-minute 
segments coded at 5-minute intervals in the areas of (a) subject(s) taught, (b) teacher orientation 



2 We found that the whole school day observations did not allow us to see a broad range of implementation levels and 
classrooms events. Therefore, in Year 2, upon reflection and data analysis, we made the decision to move to one-hour 
observations across each grade level. 



(e.g., teacher-led, small group), (c) teacher behaviors (e.g., lecture, facilitate discussion), and 
(d) student behaviors (e.g., listening, reading). The interval coding section also includes 
measures of time-on-task and academic engagement. 

Part IV: Overall Observation. This section is used to record the extent to which different 
teaching and learning approaches (e.g., cooperative learning, direct instruction, seatwork, use of 
computers) were used during the overall observation. In order to customize the COM for use in this 
study, we also asked the observer to rate the extent to which there was evidence of Core Knowledge 
content in the observed lesson. 

Part V: Comments. This section provides space for the observer to record field notes and 
comments on the observed classroom events. 

Due to the extensiveness of data collection and analyses, only major results from the COM 
analysis are presented in this report with an emphasis on identifying issues that are most salient to 
Core Knowledge. 

Teacher Surveys. We surveyed teachers in Grades 1-5 in all 12 Core Knowledge schools 
in May, 1997 to gain a more broad overview of implementation issues and to assess the level of 
implementation of Core Knowledge across the schools. In May, 1998, we again surveyed teachers 
in all schools, but only those in Grades 3 and 5, as these were the grade cohorts we followed during 
the third year of our study. We also felt that surveying two grade levels would give us a 
representative picture of implementation across the school without burdening all teachers with the 
duty of completing questionnaires. 

The questionnaire was divided into two parts. The first part of the questionnaire asked 
teachers a range of questions related to Core Knowledge implementation, including questions about 
the resources that have aided them in the implementation of Core Knowledge, the instructional 
methods used in their classrooms, and the time they spend teaching Core Knowledge. Most 
questions allowed teachers to respond with a choice of answers; a few were open-ended. 

In the second part of the questionnaire, we included a list of each topic in the Core 
Knowledge Sequence by grade level. Teachers were asked to indicate whether they had taught or 
planned to teach particular Core Knowledge topics during the school year. The survey did not ask 
teachers to report the depth in which they covered particular topics. 

The questionnaires provided name anonymity; however, teachers were identified by school 
and by grade level. In 1997, surveys were mailed to teachers, and they were asked to return the 
surveys by mail. Forty-six percent of teachers in advanced implementation sites and 39% in new 
implementation sites returned the survey. In 1998, in order to achieve a greater return rate, we hand- 
delivered surveys to teachers during our site visits to the schools. In many cases, we were able to 
pick up completed surveys during our visits. However, some teachers mailed their completed 
surveys to us. Overall, the return rates were much improved: 78% of third and fifth grade teachers 
in advanced implementation sites returned completed surveys; 91% of third and fifth grade teachers 
in new implementation sites returned surveys. 
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Qualitative Data Synthesis. We triangulated data from interviews, classroom observations, 
teacher surveys, and school documents in order to help establish reliability of our study findings. 
Qualitative data analysis was ongoing throughout the three years of the study, and involved coding 
data and developing within- and cross-case data reports and matrices in an effort to identify patterns 
and key issues within and across sites (Miles & Huberman, 1994). In sum, this final report relies on 
a synthesis of findings from a diverse set of qualitative (and quantitative) data sources. 



B. Quantitative Component 

The quantitative component of this evaluation examined (a) experimental-control differences in 
achievement gains over three years, (b) the relationships between level of implementation 
(determined through three-year case studies) and academic gains, and (c) differences in gain by 
cohort (one cohort was followed from first through third grade at each school, and a second cohort 
was followed from third through fifth grade). The primary method that we used in the quantitative 
evaluation was a quasi-experimental design, which compared four Core Knowledge schools to four 
matched comparison schools. Only students for whom both pre- and post-testing data are available 
were included in any “gain over time” analyses. 

Two subtests (Reading Comprehension and Math Concepts and Applications) of the 
Comprehensive Test of Basic Skills, Fourth Edition (CTBS/4) were administered to first and third 
graders in all Core schools and comparison schools at the beginning of Year 1 of the study as 
pretests. In sites that conducted their own CTBS or other comparable testing (e.g., CAT, ITBS), we 
accepted locally gathered norm-referenced data. We also gathered archival data from all of the 
schools regarding attendance and school-level demographics. 

We gathered two types of outcome data on both the first-through-third-grade and third- 
through-fifth-grade cohorts in the 16 schools. First, we re-administered the CTBS subtests to all 
third grade students in the 16 schools (again, with the exception of schools already administering 
comparable tests) at the end of Year 1 (1996), and to all third and fifth grade students at the end of 
Y ear 3 of the study (1998). 

Second, in collaboration with the Core Knowledge Foundation, we developed third and fifth 
grade tests of Core Knowledge, which include Language Arts, Social Studies, and Science sub.ests 
derived from content in the Core Knowledge Sequence: Content Guidelines for Grades K-6 (1995). 
The initial third grade test, of 45 minutes duration, was administered in all 16 schools in this study 
in the spring of 1 996. We again administered the third grade test and the fifth grade test to all third 
and fifth graders in the third year of the evaluation (May, 1998). 

A more detailed description of the gathering and analysis of achievement data is provided 
in Section IV. C. 
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III. Cross-Case Analysis of Core Knowledge 
Sequence Implementation 



A. A Longitudinal Look at Core Knowledge Implementation 

A new curriculum or other reform can only impact students if it is implemented. Research from the 
Sustaining Effects Study (Berman & McLaughlin, 1977; 1979), Disseminating Efforts Supporting 
School Improvement (DESSI) (Crandall etal., 1982), and Special Strategies (Stringfieldetal., 1997) 
have all concluded that level of implementation is a significant predictor of student achievement 
gain. This gain is over and above any general positive effect of participation in a particular program. 

Therefore, questions as to the levels of implementation achieved in this study’s 1 2 schools and 
factors affecting those levels of implementation are considered before examining evidence of effects. 
In this report, analyses of implementation are presented in the following order: (a) teachers’ reports of 
the level of Core Knowledge content coverage; (b) classroom observations of level of implementation; 
(c) a cross-case analysis of the forces that shape the implementation of Core Knowledge; and (d) a list 
of components for successful Core Knowledge implementation. In Section V of this report, we provide 
individual case studies of implementation, coupled with data on student outcomes at each school. 

We began this study in the fall of 1995 with a list of six schools identified as new, promising 
implementation sites, and six advanced implementation sites. Of the six schools identified as new 
or promising, four had implemented Core Knowledge for one year by the time our study began in 
the fall of 1995, one had not yet begun implementation, and one had been implementing Core in a 
very limited fashion for two to three years. Of the six schools identified as advanced implementation 
sites, three schools were in their third year of implementation when our study began, one school was 
in its second year, and two schools had been implementing Core for four or more years. 

At the end of three years (Spring, 1998), all 12 schools were still implementing the Core 
Knowledge Sequence. Core implementation improved and increased dramatically in four of the six 
new sites over the three years. In fact, some of these sites reached implementation levels that were 
consistent with, if not superior to, some of the advanced sites. Implementation also improved or 
remained at consistent high levels in five ofthe six advanced implementation sites. Core Knowledge 
implementation waned over time considerably in one of the original advanced sites and one of the 
original promising sites, leading us to conclude that while all 12 schools reported that they were 
implementing Core Knowledge, 10 schools were authentically doing so. 

These assessments of overall implementation level are based on data collected in interviews 
with teachers, administrators, and students; classroom and school observations; and teacher survey 
data on content coverage. In the following sections, we present findings from these various data 
sources. 
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B. Teacher Reports on Level of Core Knowledge Content Coverage 



Teacher survey data is rather revealing of content coverage differences across sites. Table 2 shows 
a comparison of content coverage rates between teachers in new and advanced Core Knowledge 
sites. 



Table 2: Core Knowledge Content coverage as reported by teachers: Comparison of new 
and advanced implementation sites in 1997-98 



Topic Category 


Third Grade 


Fifth Grade 




New CK 
Schools 


Advanced CK 
Schools 


New CK 
Schools 


Advanced CK 
Schools 


Poems 


49% 


64% 


44% 


62% 


Sayings/Phrases 


75% 


94% 


81% 


91% 


Language Arts 


95% 


91% 


78% 


95% 


Stories 


57% 


66% 


38% 


68% 


Mythology 


47% 


68% 


n/a 


n/a 


Literature 


n/a 


n/a 


77% 


88% 


Geography 


52% 


77% 


74% 


90% 


World Civilization 


66% 


84% 


50% 


66% 


American Civilization 


71% 


91% 


62% 


85% 


Science 


73% 


85% 


72% 


80% 


Math 


94% 


92% 


89% 


92% 


Mean percentages 


68% 


81% 


67% 


82% 



In 1998, in both Grades 3 and 5, teachers in new sites reported covering less content 
(a difference of 1 2- 1 6% overall) than their advanced implementation site counterparts. The greatest 
differences between the sites appeared in the coverage of fifth grade stories, third grade mythology, 
and fifth grade American civilization. The smallest differences in content coverage were in third 
grade language arts and math. Within each type of site (new vs. advanced), content coverage was 
remarkably consistent across grade levels. 

Figure 1 shows the specific coverage of math topics as reported by third grade teachers in 
new implementation sites during the 1997-98 school year. 

Figure 1 shows that third grade teachers in advanced sites reported covering or planning to 
cover 92% of Core Knowledge topics in math. This is roughly consistent with the math content 
coverage (94%) reported by third grade teachers in new sites. See Figure 2. 

While third grade math is an example of a topic area in which there was consistency 
between the new and advanced sites, we found rather stark differences in content coverage of 
American Civilization topics among fifth grade teachers in advanced and new sites. Figure 3 shows 
the specific coverage of American Civilization topics by teachers in advanced implementation sites 
during the 1997-98 school year. 
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Math 



Figure 1: 

Percentage of 3 rd 
grade teachers 
in advanced 
implementation sites 
who taught or planned 
to teach 
specific Core 
Knowledge content 
in the area of Math 



numbers and number sense 
read/write numbers 
place value up to 100,000 
order and compare numbers 
count by 2’s, 3’s. 5’s, 10's 
Identify ordinal position 
round to nearest 10th 
Identify perfect squares and square roots 
Identify Roman numerals 1-20 
Introduce negative numbers 
create/interpret bar graphs 
fractions to 1/1 0th 
Identify numerator/denominator 
mixed numbers 
equivalent fractions 
read/write decimals 
write amounts of money 
computation 

mastery of basic addition, subtraction, multiplica 
mentally estimate a sum 
addition: wlth/wltnout regrouping 
subtraction: with/without regrouping 
multiplication 
multiply two whole numbers 
solve word problems 
division 
divide by 0 or 1 

divide 2- and 3-digit dividends by 1-dlglt divisor 

remainders 
solve two-step word problems 
solve equations 
solve problems with more than one operation 

measurement 
linear 
weight 
capacity 
temperature 
time 
geometry 
lines 
polygons 
angles 
compute area 
congruent figures, lines of symmetry 
solid figures: sphere, cube, pyramid 
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Figure 2: 

Percentage of 3 rd grade teachers 
in new implementation sites 
who taught or planned to teach 
specific Core Knowledge content 
in the area of Math. 
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American Civilization 



Figure 3: 

Percentage of 5 th grade 
teachers in advanced 
implementation sites who 
taught or planned to teach 
specific Core Knowledge 
content in the area of 
American Civilization. 
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Figure 4: 

Percentage of 5 th grade teachers in 
new implementation sites who 
taught or planned to teach specific 
Core Knowledge content in the 
area of American Civilization. 




Figure 3 shows that fifth grade teachers in advanced sites covered or planned to cover 
85% of the Core Knowledge content in American Civilization. In contrast, Figure 4 shows that 
fifth grade teachers in new sites covered or planned to cover 62% of the content in American 
Civilization. 

As these figures show, the consistency of content coverage in advanced vs. new sites 
varied according to subject area and grade level. Section V provides overall content coverage 
data by school. The following section provides classroom observation data on implementation. 



C. Classroom Observation Data on Implementation 

We analyzed the observer ratings across and within schools to assess Core Knowledge 
implementation. We observed each third and fifth grade classroom at least twice during the 
1997-98 school year for an hour at a time. We have reasonable confidence that these findings 
represent a fairly accurate measure of implementation, as most teachers did not know in advance 
when we would be observing their classrooms. Figure 5 reports data on the percentage of 
classrooms in each school with some or extensive evidence of Core Knowledge being taught. 

Figure 5 shows that there is considerable variation both between new and advanced 
implementation sites, as well as within each group. An average of 59% of classrooms in new 
implementation sites and 75% of classrooms observed in advanced implementation sites showed 
evidence of Core Knowledge during our unannounced observations. These numbers are 
remarkably consistent with the percentages of content coverage reported by the teachers 
presented in Table 2. 

With the exception of Garvey and Colonial, all of the sites showed evidence of Core 
Knowledge in at least 50% of the classroom observations. An extensive discussion of the factors 
that led to diverse levels of implementation in the each of the school sites is provided in Section V. 

Finally, we conducted a descriptive analysis of the teaching and learning approaches 
observed in Core Knowledge classrooms. Figure 6 shows the percentage of classrooms across 
schools where particular instructional strategies were observed. 

Figure 6 shows that independent work by students was the most prevalent instructional 
strategy observed. We can infer that much of this independent work was skill-oriented, as 
sustained writing/composition (either self-selected or teacher generated topics) was observed in 
only 29% of classrooms. Direct instruction of material to the entire class was also commonly 
observed. Not surprisingly, the data on the prevalence of student discussion is consistent with the 
data on the teacher acting as a coach or facilitator. Interdisciplinary instruction or an integration 
of two or more subject areas characterized almost half of the classrooms. Thirty percent of 
classrooms observed included some experiential, hands-on learning activities, and 44% of the 
classroom observations included some cooperative learning among students. Computers and 
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other technologies (e.g., overhead or film projectors) were used as instructional tools in only 
one-quarter of the classrooms observed. From these results, we can conclude that most Core 
Knowledge classrooms are characterized by a mix of joint productive activities between teachers 
and students (Tharp, 1997) and more traditional methods of instruction. 
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D. Forces that Shape the Implementation of Core Knowledge: 

A Cross-Case Analysis 



A comparative, cross-case analysis of the Core Knowledge schools in our longitudinal study 
suggests that there are four major forces that shape Core Knowledge implementation: 

1 . The nature of the reform model itself; 

2. Local context, including reasons for adopting the reform; 

3. Systemic and policy conditions; 

4. Capacity for change, including material and human resources. 

In the following section, we consider the impact of these forces on the implementation of Core 
Knowledge. 

The Nature of the Reform 

One of the major forces that impacted the implementation of Core Knowledge in the 12 schools 
is the nature of the reform itself, which has specific and collectively unique characteristics. 

Limited Implementation Guidelines. Unlike some other school reform groups that set 
forth a planned progression for which parts of the reform should be implemented each year (e.g., 
Accelerated Schools [Finnan et al., 1996; Levin, 1987] and Success for All [Slavin et. al, 1996b] ), 
the Core Knowledge Foundation has historically left these decisions to local educators. Only 
recently has the Foundation begun to get more specific in its guidelines for implementing the Core 
Knowledge Sequence. When they began implementation, most of the schools in our study had 
available to them a guide called A School's Guide to Core Knowledge: Ideas for Implementation 
(Jones, 1991), which was published by the Core Knowledge Foundation. This concise, 13-page 
guide draws upon the experiences gained by educators in the first Core Knowledge school to give 
educators in other schools ideas for getting started with Core Knowledge. However, these were 
intended to be loose guidelines or suggestions, not strict rules for implementation. 

The absence of a specific implementation plan led to substantial variability across the 12 
schools in how they chose to implement the curriculum. One of the main areas of variance is the 
speed with which schools incorporate the curriculum. Several schools in the sample “jumped 
into full implementation the first year,” as one principal described. Others chose to phase in 
grade by grade or parts of the curriculum one at a time (i.e., history followed by literature, etc.). 
For example, at Riverside, teachers experimented with teaching a number of Core Knowledge 
units the first year; during the following year, the principal encouraged teachers to teach the units 
they thought would be the most interesting. “The goal was to get them familiarized with 
integrated teaching,” explained the principal. Gradually, over the course of two years, teachers at 
this school developed units during established meeting times. The principal explained: “We’d 
rather take our time and have some really strong units.” 



Another school used a grade-by-grade, phase-in implementation approach, beginning 
with the first and second grades in the first year, adding third grade the second year, and fourth 
and fifth the following year. This strategy was chosen because there was initially greater 
consensus for implementing the Core in the primary grades, and while the upper grades 
supported the school’s adoption of the curriculum, the phase-in approach allowed them to “look 
at it, test it out, and maybe even try it in their classroom without committing to it.” At another 
advanced site, High Country, teachers reported: “We had a year to prepare before we had to 
teach it. We weren’t just thrown into it. We could just gather supplies, gather information, 
become familiar with it, and try the units we had materials for already.” 

Many teachers at the strongest implementation sites stated that the lack of specificity in 
implementation was one of the reform’s chief positive attributes. Paradoxically, we also 
observed cases where the lack of a clear, time-specific implementation package resulted in 
substantially sub-optimal initial implementation, followed by a multi-year decline in level of 
implementation. When schools were under substantial pressure from districts or states to achieve 
one goal (e.g., higher basic skills test scores) while attempting to conduct the non-specific 
implementation process of Core Knowledge, the implementation of Core tended to be pushed 
aside. This was characteristic of the two low implementation sites, Garvey and Colonial. In these 
sites, perhaps a more specified implementation plan for Core Knowledge would have been more 
effective in getting the curriculum institutionalized. 

A second area of variance, which is related to the lack of specificity for implementation 
provided by the Core Knowledge Foundation, is the time spent teaching Core Knowledge. The 
Core Knowledge Foundation suggests that Core Knowledge material comprise “about half of any 
school’s curriculum, thus leaving ample room for skills instruction and local requirements and 
emphases” (Core Knowledge Foundation, 1995, p. 4). In our interviews with teachers, we asked 
them how much time was spent teaching Core Knowledge. Overwhelmingly, teachers at the 
advanced implementation sites stated that they spent more than 50% of their time teaching Core 
material. Estimates were generally in the 60% range, with some as much as 75%. These higher 
estimates were generally the result of teachers’ integrating Core content into their other, more 
traditional skills instruction time. This percent-of-time dimension varied by teacher, school, and 
year, with the schools experiencing the greatest pressure to raise test scores also characterized by 
substantial declines in Core Knowledge time. It is important to note that teachers also varied 
widely in how much time they give to a particular topic or unit. Some chose to simply expose 
children to the material whereas others chose to pursue particular topics in depth. 

Conversely, teachers at most of the new implementation sites had lower estimates of the 
amount of time they spent teaching Core Knowledge, generally less than 50%. A teacher at one 
new site with a slow phase-in approach stated: “I call Core Knowledge the icing on the cake... 
And the children love it because there is no pressure.” She added: “Each year I’m adding more. I 
started very slowly.” Another teacher explained that it comprised about a quarter of what she 
teaches. She explained that teaching reading was her top priority. 
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Finally, because the Core Knowledge Foundation, unlike many other school reform 
groups (e.g., the Comer School Development Program [Comer & Haynes, 1996]), does not give 
specific guidelines on how schools should restructure, Core Knowledge schools made 
organizational changes that made sense to them within their local context. For example, one of 
the advanced implementation sites recently reorganized their fifth grade so that instead of 
students switching teachers for each academic subject, they now have only two teachers — one 
for math and science and one for language arts and social studies. The principal explained the 
rationale behind this change: “Core Knowledge really involves a great deal of hands-on 
activities. We felt that by saying it’s time to stop, we have to move to our next subject. We really 
were putting up a barrier for the kids who wanted to continue. And many of the activities that we 
do with Core Knowledge take longer than just a forty-five minute class time.” 

The absence of a concrete implementation plan for Core Knowledge appeared to hold 
both advantages and disadvantages. Clearly, it allowed for local variation in organization and 
implementation strategies, and, in diverse contexts, unique strategies appeared to be succeeding. 
Still, there were schools in which a more concrete plan with well-described steps (perhaps laid 
out by the school staff or administration in coordination with consultants from the Core 
Knowledge Foundation) might have led to a higher level of implementation. 

Beginning in 1996, when Connie Jones, the principal of the first Core Knowledge 
school, joined the Core Knowledge Foundation staff as Vice-President and Director of School 
Programs, the Foundation began to expand its, implementation guidelines. Workshops are now 
offered to assist schools in planning for Core Knowledge implementation. Still, even as of 
December, 1998, the only thing that new Core Knowledge schools must commit to doing is 
teaching all of the Core topics at the grade levels specified by the end of the third year of 
implementation. The speed at which schools phase in the curriculum is entirely up to the 
individual schools, as is the specific amount of time spent on Core Knowledge topics. 

No Pre-packaged Materials for Teachers and Students. A second way in which Core 
Knowledge differs from some other externally developed school reform models is with regard to 
materials provided for students and teachers. Schools have available to them the Core 
Knowledge Content Guidelines for Grades K-6 (Core Knowledge Foundation, 1995), which 
includes a listing of the topics to be taught, the What Your [K-6] Grader Needs to Know books 
(e.g., Hirsch, 1993), which are intended mainly for parents, and Books to Build On (Holdren & 
Hirsch, 1996). This last resource, an annotated bibliography of Core Knowledge source material 
for educators, was not available when the study began. 3 The Core Knowledge Foundation does 
not directly specify the books, materials, or lesson plans teachers should use to teach Core 
Knowledge (though Books to Build On gives suggestions of resources), nor does it give guidance 
as to pedagogical strategies. There is no Core Knowledge teacher manual, nor are there 
textbooks or other materials for children. However, teachers share lesson plans at the annual 



3 Nearly two years after it was published, many of the teachers we surveyed in the spring of 1998 had not heard of it. 
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conference and some plans (developed by teachers in Core schools) are posted on the World 
Wide Web. 

Our survey showed that the majority of teachers were provided with a copy of What 
Your [X] Grader Needs to Know during the past three years and copies of the Core Knowledge 
Sequence: Content Guidelines for Grades K-6. However, the absence of prescribed materials and 
guidance for instruction resulted in a great diversity of instructional strategies used by teachers 
across the sites (see Figure 6). In the survey, we asked teachers to rank the three instructional 
techniques they use most often. The three techniques used most often by teachers in the 12 
schools included teacher-made materials, thematic units, and trade books. Most schools reported 
changing their instructional strategies with the introduction of Core Knowledge. For some, this 
meant “more project teaching, more hands-on, build-it, create-it types of teaching, and less 
dependence on textbooks than ever,” as one educator described. Similarly, a principal at another 
school explained: “With adopting Core Knowledge, which has a lot of content that you won’t 
find in the basal reading series, we went to a children’s literature, whole-language approach to 
teaching reading and writing.” 

An educator at Englewood concurred, explaining that they had integrated whole 
language and a “Multiple Intelligences, varied learning styles approach” when they implemented 
Core Knowledge. At this school, Core was seen as vehicle for thematically blending subjects 
across the curriculum. By contrast, another school in our sample, Newton, favored a more 
fundamental, back-to-basics approach that included phonics and a direct instruction, traditional, 
whole-group delivery system. Two schools used the What Your [X] Grader Needs to Know 
books in the classroom. As one principal explained in an interview: “We bought What Your [X] 
Grader Needs to Know just as a class set. We called it our reference guide. ‘Take your Core 
Knowledge reference guide, and turn to the kingdoms of ancient Africa, and let’s find out about 
kingdoms of Chad,’ and so forth.” 

We heard varied responses from teachers and principals as to whether or not they would 
prefer to have prescribed materials or lesson plans for Core Knowledge. Particularly in the 
advanced implementation sites, all of which had been implementing Core Knowledge for at least 
four years, we found that the majority of educators spoke positively about the absence of 
materials. As one principal stated: 

I would hate to see us formalize [Core Knowledge] to a point that it’s almost a 
textbook approach. Because once we start having a Core Knowledge textbook, 
then Core Knowledge is going to be just like everything else. It’s not going to be 
a real change process; it’s just going be another series you adopt. 

Some teachers also agreed that prescribed lesson plans and materials for Core 
Knowledge would reduce the possibility of positive collaborative relationships among teachers 
that were created through joint planning. Many teachers also enjoyed conducting the research 
and developing their own lesson plans that fit with their style of teaching. A teacher at an 
advanced implementation site explained: “I think when you get into how to teach, that’s when 



you meet resistance.... When you bring in a new package that says ‘this is the stuff we want you 
to teach and this is how to teach it,’ I think a wall comes up immediately.” Another teacher 
reiterated: “I really appreciate the fact that the foundation deemed classroom teachers educated 
enough to handle it.” Some teachers disagreed. One teacher explained: “I think the Core 
Foundation would be doing a great service if they looked seriously at the skills that go along 
with content.... I think the scope and sequence should be set.... I think assessment should be 
added as well.” 

In addition, because of the absence of prescribed materials and lesson plans for Core 
Knowledge, many teachers reported spending remarkable amounts of time planning lessons and 
gathering materials, particularly in the first one-to-two years of implementation. As one teacher 
described: “That first year, [at home] I’d get the kids to bed... and I’d be sitting with the 
encyclopedia researching the colonies.” Although most teachers stated that the time commitment 
and level of work required for preparation lessened over time, especially after the first two years, 
the considerable and even burdensome amount of time required by teachers in planning 
constituted a hindrance to implementation in some schools. In addition, almost every teacher we 
interviewed expressed difficulty in finding age-appropriate materials for various units. For 
example, teachers had trouble finding materials for first graders on the U.S. Westward 
Expansion. 

More recently, as of December 1998, the Core Knowledge Foundation has begun to 
provide teachers with copies of sample lesson plans, in addition to copies of the Core Knowledge 
Sequence, when schools participate in Core Knowledge Professional Development workshops. 
However, these lessons are intended to serve simply as examples. In addition, the Baltimore 
Curriculum Project, a non-profit organization that is working with schools in Baltimore 
implementing both the SRA Direct Instruction Program and Core Knowledge, has developed 
Core Knowledge lesson plans, which are available for purchase. 

Limited Professional Development. Some externally developed reforms (e.g., Success 
for All [Slavin et al., 1996a], the New American Schools Designs [see Stringfield, Ross, & 
Smith, 1996; Smith et al., 1998] ) require structured professional development for teachers. By 
contrast, Core Knowledge historically (before August, 1996) neither required nor offered 
professional development. At most, the schools in our sample received short overview 
presentations from Core Knowledge Foundation staff, and this occurred only in a couple of 
cases. 4 



4 More recently, the Foundation has substantially increased its professional development offerings. However, none of 
the workshops are required, unless schools contract with the Foundation as part of their federal Comprehensive School 
Reform Demonstration Program grant applications. In these cases, the Core Knowledge Foundation requires a formal 
application process which includes a letter of commitment stating how buy-in of 80% of the staff was obtained. 
Schools must also submit a school-wide planning document that includes a year-long plan for teaching Core and state 
and district standards, and schools must submit sample lesson plans. They must also participate in all training 
workshops and spend a minimum of $200 per teacher on Core Knowledge-related resource materials. 



